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Abstract 

We present a new algebraic algorithmic scheme to solve convex integer maximization problems 
of the following form, where c is a convex function on K d and W\x, . . . , WdX are linear forms on R n , 

max {c(w\x, . . . , Wd,x) : Ax = b, x G N"} . 

This method works for arbitrary input data A, b, d, w%, . . . , Wd, c. Moreover, for fixed d and several 
important classes of programs in variable dimension, we prove that our algorithm runs in polynomial 
time. As a consequence, we obtain polynomial time algorithms for various types of multi-way 
transportation problems, packing problems, and partitioning problems in variable dimension. 
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1 Introduction 

In the past fifteen years algebraic geometry and commutative algebra tools have shown their exciting 
potential to study problems in integer optimization (see [U [30] and references therein). But, so far, 
algebraic methods have always been considered "guilty" of bad computational complexity, namely, the 
notorious bad complexity for computing general Grobner bases when the number of variables grow 
(see |22J and references therein). This paper demonstrates that, by carefully analyzing the structure of 
toric ideals in particular problems, algebraic tools can compete (and win!) against more mainstream 
tools in optimization. 

The main algebraic ingredient we will need is the notion of Graver bases, a special kind of universal 
Grobner bases for the toric ideals associated with integer matrices. We recommend the introduction 
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presented in Chapter 4 of [28] for a basic introduction to Grobner and Graver bases of toric ideals. We 
consider a new algorithmic scheme for solving the following far-reaching generalization of standard 
linear integer programming: 

Convex Integer Maximization. Given positive integers d, m, n, integer vectors roi,...,M)d£Z n and 
b G 7j m , integer matrix A G 'Z mxn , and convex function c : R d — > R, find a nonnegative integer vector 
x G N n maximizing the objective function c(w\x, . . . , w^x) subject to the equation system Ax = b, 

max {c(wix, . . . , w^x) : Ax = 6, x G N n } . 

This problem can be interpreted as multi-objective integer programming: given d different linear objec- 
tive functions w±, . . . , Wd, the goal is to maximize their "convex balancing" given by c(w±x, . . . , wax). 
The convex integer maximization problem is very expressive and in fact, contains a whole hierarchy of 
problems of increasing generality and complexity, parameterized by the number d of linear objectives 
used: at the bottom lies the standard linear integer programming problem, recovered as the special 
case of d = 1 and c the identity on R; and at the top lies the problem of maximizing an arbitrary 
convex functional over the set of integer points in a rational polyhedron in M n , arising with d = n and 
Wi = lj the i-th standard unit vector in R n for all i. 

In general, convex integer maximization is intractable even for small fixed d, since already for d = 1 
it includes linear integer programming which is NP-hard. For variable d, even very simple special cases 
are NP-hard, such as the following instance (positive semi- definite quadratic binary programming), 

max{(^ix) 2 H h (w n x) 2 : X{ + yi = 1 (i = l,...,n), x,yGN"}. 

Clearly, the complexity of the problem depends also on the presentation of the convex function: we will 
assume that c is presented by a comparison oracle that, queried on x,y G R d , asserts whether or not 
c(x) < c(y). This is a very broad presentation that reveals little information on the function, making 
the problem harder to solve. In particular, if the polyhedron {x G R™ : Ax = b} is unbounded, then 
the problem is inaccessible even in one variable with no equation constraints: consider the following 
family of univariate convex integer programs with convex functions parameterized by — oo < u < oo, 

— X if X <Z w 

max{c n (x) : x G N} , c u (x) := < ' ; 

I x — 2u, it x > u. 

now consider any algorithm attempting to solve the problem and let u be the maximum value of x 
in all queries to the oracle of c; then the algorithm can not distinguish between the problem with c U: 
whose objective function is unbounded, and the problem with Coo, whose optimal objective value is 0. 
(We remark that, for explicitly given (rather than oracle presented) simple convex functions, it might 
be possible to handle unbounded feasible regions as well; this should be the subject of future study.) 

In spite of these difficulties, we show in this article that the algebraic techniques of Graver bases 
allow us to solve the convex integer maximization problem in polynomial time for a large and useful 
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class of integer programs in variable dimension. Moreover, this class is universal for integer program- 
ming in a well defined sense, enabling to extend this to an algorithmic scheme for solving convex 
integer maximization over arbitrary integer programs. 

Our first key lemma, extending results of [23] for combinatorial optimization, shows that when a 
suitable geometric condition holds, it is possible to efficiently reduce the convex integer maximization 
problem to the solution of polynomially many linear integer programming counterparts. As we will 
see, this condition holds naturally for a broad class of problems in variable dimension. To state this 
result, we need the following terminology. A direction of an edge (1-face) e of a polyhedron P is an 
nonzero scalar multiple of u — v with u, v any two distinct points in e. A set of vectors covers all 
edge- directions of P if it contains a direction of each edge of P. A linear integer programming oracle 
for matrix A G 'Z mxn and vector b G Z m is one that, queried on w G Z n , solves the linear integer 
program m&x{wx : Ax = b, x G N n }, that is, either returns an optimal solution x G N n , or asserts 
that the program is infeasible, or asserts that the objective function w is unbounded. 

Lemma 1.1 For any fixed d there is a strongly polynomial oracle-time algorithm that, given any vec- 
tors wi, . . . ,Wd G IT 1 , matrix A G j J mxn an d vector b G Z m endowed with a linear integer programming 
oracle, finite set £cZ" covering all edge- directions of the polyhedron conv{x G N n : Ax = b}, and 
convex functional c : M d — > M presented by a comparison oracle, solves the convex integer program 



Here, solving the program means that the algorithm either returns an optimal solution x G N n , or 
asserts the problem is infeasible, or asserts the polyhedron {x G : Ax = b} is unbounded in which 
case the problem is hopeless (see discussion above); and strongly polynomial oracle-time means that 
the number of arithmetic operations and calls to the oracles are polynomially bounded in m and n, and 
the size of the numbers occurring throughout the algorithm is polynomially bounded in the size of the 
input (which is the number of bits in the binary representation of the entries of w\, . . . , Wd, A, b, E). 

Our main theorem, building on Lemma ll.ll shows that a broad (in fact, universal) class of convex 
integer maximization problems can be solved in polynomial time. Given an (r + s) x t matrix A, let 
A\ be its r x t sub-matrix consisting of the first r rows and let A2 be its s x t sub-matrix consisting 
of the last s rows. Define the n-fold matrix of A to be the following (r + ns) x nt matrix, 



max {c{w\x, . . . , Wd,x) : Ax = b, x G N n } . 



A x 



Ai\ 



A 2 















A {n) 



(l n ® A{) (I n <g> A 2 ) 







A 2 











\ ••• A 2 J 

Note that A^ depends on r and s: these will be indicated by referring to A as an "(r + s) x t matrix". 
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We establish the following theorem, which asserts that convex integer maximization over n-fold 
systems of a fixed matrix A, in variable dimension nt, are solvable in polynomial time. This extends 
results for linear integer programming from [T2] . 



Theorem 1.2 For any fixed positive integer d and fixed (r + s) xt integer matrix A there is a polyno- 
mial oracle-time algorithm that, given n, vectors w\, . . . , Wd G "L nt and b G Z r+ns ; and convex function 
c : R d — > R presented by a comparison oracle, solves the convex n-fold integer maximization problem 

max {c(wix, ... , Wdx) : A^x = b, x G N n *} . 



The equations defined by an n-fold matrix have the following, perhaps more illuminating, interpre- 
tation: splitting the variable vector and the right-hand side vector into components of suitable sizes, 
x = (x\ . . . , x n ) and b = (6°, b 1 , . . . , b n ), where 6° G 17 and x k G N* and b k G V for k = 1, . . . , n, the 
equations become ^4i(X]fc=i x *0 = ^° ana - ^2 xk = b k for k = 1, . . . , n. Thus, each component x k satis- 
fies a system of constraints defined by A2 with its own right-hand side b k , and the sum Ylk=i xk obeys 
constraints determined by A\ and b° restricting the "common resources shared by all components" . 

Theorem 11.21 has various applications, including to multiway transportation problems, packing 
problems, vector partitioning and clustering, which will be discussed in Section[3J For example, we have 
the following corollary providing the first polynomial time solution of convex 3-way transportation. 

Corollary 1.3 (convex 3-way transportation) For any fixed d,p,q there is a polynomial oracle- 
time algorithm that, given n, arrays w\, . . . ,Wd G ^P x '?x fl ) u g ^P x i 7 y g Z pxn , z G Z 9Xn , and convex 
c : M. d — > R presented by comparison oracle, solves the convex integer 3-way transportation problem 

max{ c(wix, . . . , w d x) : x G N pX(?xn , x i;j>k = z jjk , x ij>fc = v ijk , x iij;k = u itj } . 

i j k 

Note that in contrast, if the dimensions of two sides of the tables are variable, say, q and n, then even 
the standard linear integer 3-way transportation problem over such tables is NP-hard, see [9| I10|. fTT] . 



We proceed to discuss the universality of n-fold integer programming and describe our algorithmic 
scheme for solving convex integer maximization over an arbitrary system. Define a variant of the n-fold 
operator as follows: for an s x t matrix A, define its n-product A™ to be the n-fold product of the 
(t + s) X t matrix obtained by appending A to the t X t identity matrix I t , that is: 
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Consider m-products (1, 1, l)t m l of the 1x3 matrix (1,1,1). Note that (l,l,l)[ m l is precisely the 
(3 + m) x 3m vertex-edge incidence matrix of the complete bipartite graph K^ m . For instance, 

/iooiooioo\ 

010010010 

1 1 1 

1 1 1 
1 1 1 
000000111 



(1,1,1 



,[3] 



V 



I 



The following result which incorporates the recent universality theory of O flOl [TT] asserts that every 
convex integer maximization problem can be lifted in polynomial time to some convex integer maxi- 
mization problem defined by some n-product of some m-product of (1, 1, 1). Theorem 11.21 can then be 
harnessed to solve the lifted program, providing a general solution scheme for convex maximization. 



Corollary 1.4 (scheme for arbitrary convex integer maximization) There is a polynomial 
time algorithm that, given integer px q matrix B and b € Z p with {x £ 7L q : Bx = b , x > 0} bounded, 
computes m, n, and integer (3m + n(3 + m)) vector a such that, for any given vectors w±, ...iDdGZ' 
and any convex function c on M d , the corresponding convex integer maximization problem lifts to a 
convex integer maximization problem defined by the n-product of the m-product of (1, 1, 1), that is, 



max{c(ii;i x, . . . , w^x) : x £ Z q , Bx = b , x > 0} 



max < ciwix, . . . , wax) : x£ 



?3mn 



(1,1, 1)1" 



x, = a , x > 



, w d G Z 3m " are 



The algorithm also computes an embedding of Z 9 into T? mn so that the vectors w\ 
obtained from the corresponding vectors w\, . . . € Z 9 by simply adding sufficiently many entries. 

Proof. Reformulating the universality theorem for multiway tables from [10J in terms of products, it 
asserts that the set of integer points {x € Z 9 : Bx = b , x > 0} in any rational polytope stands in 
polynomial-time computable coordinate-embedding linear bijection with the set of integer points in 



the polytope {f G Z 3mn : ((1, 1, 1) 



x 



Wi e 



73mn 



a , x > o| for some m, n and a. Lifting each Wi £ Z 9 to 



by adding suitable entries, implies that for every integer point x in the original program 
and its corresponding integer point x in the lifted program, we have the same objective function value 
c(u>ix, . . . ,Wdx) = c(w\x, . . . ,u)dx). Thus, the optimal objective function values in the original and 
lifted programs are the same, and, moreover, an optimal solution to the original program can be read 
off as any point x corresponding to any optimal solution x, to the lifted program. □ 

Note that, if P^NP, there can be no polynomial time algorithm for general linear integer program- 
ming, let alone convex integer maximization. So how does this reconcile with the scheme suggested by 
Corollary 11.41 above ? The point is that, for every fixed m, Theorem 11.21 provides a polynomial time 
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algorithm for convex maximization over all integer programs that lift to programs with defining matrix 
that is the n-product ((1, 1, l)t w l) " of (1, 1, l)l m l. But for arbitrary integer programs, m is variable as 
well and so the whole procedure is not polynomial. But in practice, this might be efficient or enable 
a quick approximation, and should be the subject of future study. We also note that, for fixed m, the 
computational complexity of solving convex maximization over programs defined by ((1,1,1)^)^ is 
dominated by n d9 ^ m \ where g{m) is the so-called Graver complexity of the complete bipartite graph 
K^, m and of its incidence matrix (1, 1, l)[ m l . The precise rate of growth of g(m) as a function of m is 
unknown and intriguing; see [I] for the best bounds and for more details and precise definitions. 

The rest of the article proceeds as follows. In Section [2] we give the proofs of all statements. We 
begin by discussing edge-directions of polyhedra and provide the algorithm establishing Lemma 11,11 
We proceed to discuss Graver bases and, incorporating Lemma ll.ll and recent results from [12], which 
are based on results of Ho§ten and Sullivant [21] and Santos and Sturmfels [27] on the asymptotic 
stabilization of Graver bases, we are able to establish Theorem ll.2i In Section [3] we discuss applications 
to multiway transportation, packing, vector partitioning and clustering, as follows: in 13.11 we obtain 
Corollary 11.31 and an extension to k-w&y transportation problems of any dimension k (Corollary 13. ip ; 
in 13.21 we describe applications to bin packing problems (Corollary I3.2p : finally, in 13.31 we apply our 
Theorem 11.21 to vector partitioning in general and clustering in particular (Corollary I3.4j) . 

2 Proofs 

In this section we prove Lemma ll,l| which is of interest in its own right, and combine it with several 
other results to establish our main Theorem 11.21 Before proceeding with the details, we provide 
the main outline and point out the difficulties that we have to overcome. Given data for a convex 
integer maximization problem m&x{c(wix, . . . ,uidx) : Ax = b, x £ N n }, consider the polyhedron 
P := couv{x S N n : Ax = b} C M. n and its projection Q := {{w\x, . . . ,Wdx) : x G P} C M. d . Note 
that P is the so-called integer hull of {x E M n : Ax = b , x > 0} and has typically exponentially many 
vertices and is not accessible computationally. Note also that, since c is convex, there is an optimal 
solution x whose projection (u>ix, . . . , Wdx) is a vertex of Q. So an important ingredient in the solution 
is to construct the vertices of Q. Unfortunately, Q may also have exponentially many vertices even 
though it lives in a space W 1 of fixed dimension. However, we will be able to show that, when the 
number of edge- directions of P is polynomial, the number of vertices of Q is polynomial. Nonetheless, 
even in this case, it is not possible to construct these vertices directly, since the number of vertices of 
P may still be exponential. To overcome this difficulty, we need to make use of a suitable zonotope. 
This is the key idea underlying the algorithm of Lemma II. 11 Next, we restrict attention to n-fold 
systems. For such systems, using recent results of \21\ [27] on the stabilization of their Graver bases, we 
are able to show that the set of edge-directions of the integer hull P can be computed in polynomial 
time. Combining this with Lemma ll.ll and several other results from [12] we obtain Theorem 11.21 
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We now proceed with the precise details. As defined earlier, a direction of an edge (1-face) e of a 
polyhedron P is any nonzero scalar multiple of u — v where u, v are any two distinct points in e. We 
say that a set of vectors E covers all edge- directions of P if it contains a direction of each edge of 
P. A polyhedron Z is a refinement of a polyhedron P if the closure of each normal cone of P is the 
union of closures of normal cones of Z. The zonotope generated by a finite set E C W 1 is the polytope 
Z := zone(-E') := conv{^ eg£; A e e : A e = ±1}. More details and proofs of the next two propositions 
can be found in [16} 1231 IM] and the references therein. 

Proposition 2.1 Let E C M. n be a finite set covering all edge- directions of a polyhedron P C M n . 
Then the zonotope Z := zone(E) = conv{^ eg£; A e e : A e = ±1} generated by E is a refinement of P. 

Proposition 2.2 For any fixed d, there is a polynomial time algorithm that, given any E C Z d , 
outputs every vertex v of Z := zone(-E) along with g v £ 7j d with g v x uniquely maximized over Z at v. 

We can now prove Lemma 11.11 showing that a set of edge-directions of the polyhedron underlying a 
convex integer program allows to solve it by solving polynomially many linear integer counterparts. 

Lemma 11.11 For any fixed d there is a strongly polynomial oracle-time algorithm that, given any 
vectors wi, . . . , Wd £ Z n , matrix A £ 2 mxn and vector b € W 1 endowed with a linear integer program- 
ming oracle, finite set EcZ" covering all edge- directions of the polyhedron conv{x £ N n : Ax = b}, 
and convex functional c : M. d — > R presented by a comparison oracle, solves the convex integer program 

max {c(wix, . . . , Wdx) : Ax = b, x € N n } . 

Proof. We provide the algorithm claimed by the theorem. First, query the linear integer programming 
oracle of A, b on the trivial linear function w = 0; if the oracle asserts that the linear problem is 
infeasible, then terminate the algorithm asserting that the convex problem is infeasible. So assume the 
problem is feasible. Let P := convjx £ N n : Ax = b} C R n and Q := {(w\x, . . . , Wdx) : x £ P} C R d . 
Then Q is a projection of P, and the corresponding projection D := {(u>ie, . . . , u^e) : e £ 2£} of the 
set E is a set covering all edge-directions of Q. Let Z := zone(D) C M d be the zonotope generated 
by D. Since d is fixed, by Proposition 12.21 we can produce in polynomial time all vertices of Z, every 
vertex v along with g v £ 7L d such that the linear function defined by g v is uniquely maximized over Z 
at v. For each of the polynomially many g v , repeat the following procedure. Define a vector h v £ Z n by 
hv,j '■= Yli=i w i,j9v,i for j = 1, . . . , n. Now query the linear integer programming oracle of A, b on the 
linear function w := h v £ Z n . If the oracle replies that the objective is unbounded, then terminate the 
algorithm asserting that P is an unbounded polyhedron. Otherwise, let x v £ P D N™ be the optimal 
solution obtained from the oracle, and let z v := {w\x v , . . . , WdX v ) £ Q be its projection. Since for 
every x £ P and its projection z := {w\x, . . . , Wdx) £ Q we have g^z = h v x, we conclude that is a 
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maximizer of g v over Q. Now we claim that each vertex u of Q equals some z v . Indeed, since Z is a 
refinement of Q by Proposition 12. 11 it follows that there is some vertex v of Z such that g v is uniquely 
maximized over Q at it, and therefore it = z v . Suppose that the linear integer programming oracle 
replied with an optimal solution to each query. Since Z refines Q, this implies that Q is bounded hence 
a polytope. Since c{w\x, . . . , w&x) is convex on W n and c is convex on M. d , we have that 

max{c(i«ii, . . . , Wdx) : Ax = b, x G N™} = m&x{c(wix, . . . , w^x) : x € P} 

= max{c(z) : z £ Q} = max{c(u) : it vertex of Q} = m&x{c(z v ) : v vertex of Z} . 

Using the comparison oracle for c, identify that z v achieving maximum value c{z v ) over all vertices v 
of Z, and output x v which is the optimal solution to the convex integer programming problem. □ 

Recall that solving the convex integer program means that the algorithm either returns an optimal solu- 
tion x € N™, or asserts that the problem is infeasible, or asserts that the polyhedron {x £ K n : Ax = b} 
is unbounded in which case the problem is generally hopeless (see discussion in the introduction). It 
may happen, though, that the projection Q of P is bounded even though P is not: in this case, there 
is an optimal solution to the convex integer programming problem, and our algorithm will find it. 

Lemma 11.11 bares at once useful consequences for systems whose defining matrix A is totally 
unimodular, such as network flow problems and ordinary (2- way) transportation problems. For such 
totally unimodular systems, the relevant polyhedron P is integer, that is, we have the equality 

P := conv{x £ N n : Ax = b} = {x G R™ : Ax = b} := L . 

This implies the following two useful properties: first, for any integer vector b, a linear integer pro- 
gramming oracle for A, b is polynomial time realizable by linear programming over L; and second, a 
set E covering all edge-directions of P is provided by the set of circuits of A, that is, minimal-support 
linear dependencies on the columns of A, whose cardinality is bounded above by ("). If m grows 
slowly, say m = O(logn), then this bound is sub-exponential and the algorithm underlying Lemma 
11.11 might provide a good strategy for addressing the convex integer maximization problem. 

Next, we proceed to prove Theorem ll.2i We need to recall some definitions. The Graver basis of an 
integer matrix A, introduced in [15J, is a canonical finite set Q{A) that can be defined as follows. Let 
C(A) := {i £ Z n : Ax = 0} be the lattice of integer linear dependencies on A. Define a partial order 
C on Z n which extends the coordinate-wise order < on N n as follows: for two vectors u, v 6Z n put 
u C v and say that u is conformal to v if \v,i\ < \vi\ and UiVi > for i = 1, . . . , n, that is, u and v lie in 
the same orthant of W 1 and each component of u is bounded by the corresponding component of v in 
absolute value. The Graver basis of A is then the set Q{A) of all C-minimal vectors in C{A) \ {0}. For 
instance, if A = (1,2,1) then Q(A) = ±{(2, -1, 0), (0, -1, 2), (1, 0, -1), (1, -1, 1)}. For more details on 
Graver bases and the currently fastest procedure for computing them see |28t [T71 118j . 
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It is known that the universal Grdbner bases of A, namely the union of all reduced Grdbner bases 
of the toric ideal of the matrix A, contains all edge directions in the integer hulls within the polytopes 
Pb = {x : Ax = b, x > 0} (see Section 5 in [29] . Since the Graver bases contains this universal one can 
deduce the following property (we include a direct proof here): 

Lemma 2.3 For every integer matrix A G Z mxn and every integer vector b G N m , the Graver basis 
G(A) of A covers all edge- directions of the polyhedron conv{x G N n : Ax = b} defined by A and b. 

Proof. Consider any edge e of P := conv{x G N ra : Ax = b} and pick two distinct points u, v G e D N n . 
Then g := u — v is in C(A) \ {0} and hence g is a conformal sum g = ^g 1 with g % C g and g l G Q(A) 
for all i. To see this, recall that G(A) is the set of C-minimal elements in C(A) \ {0} and note that C 
is a well-ordering; if g G G(A), we are done; otherwise there is an h G G(A) with h C g in which case, 
by induction on C, there is a conformal sum g — h = Yld 1 giving the conformal sum g = h + ^2g l - 

Now, we claim that u — g % G P for all i. To see this, note first that g l G £7(-A) C >C(A.) implies 
Ag* = and hence A(u — <?*) = = 6; and second, note that u — g l > 0: indeed, if < then 
— 5* > > 0; and if g^ > then g l Q g implies <?* < gj and therefore Uj — g^ > Uj — gj = Vj > 0. 

Now let w € R n be a linear functional uniquely maximized over P at the edge e. Then for all i, as 
just proved, u — g l € P and hence wg l > 0. But ^ wg* = = wu — wv = 0, implying that in fact, 
for all i, we have wg l = and therefore u — g 1 £ e. This implies that each g l is a direction of the edge 
e (in fact, moreover, all g l are the same, so g is a multiple of some Graver basis element). □ 

We also need the following two recent results from |12| on n-fold systems. The first result builds on 
stabilization of Graver bases established by Ho§ten and Sullivant [21] and Santos and Sturmfels [27] . 

Proposition 2.4 For any fixed (r + s)xt integer matrix A there is a polynomial time algorithm that, 
given any n, computes the Graver basis G{A^) of the n-fold matrix A^ = (l n <g> A\) © (J n (g> A2). 

The second result of [12] combines Proposition 12.41 and the use of the Graver basis for augmentation. 

Proposition 2.5 For any fixed (r + s) xt integer matrix A there is a polynomial time algorithm that, 
given n and vectors w £ Z nt and b G 7 l r+ns , solves the linear n-fold integer programming problem 

max{wx : A^x = b, x G N 71 '} . 
Combining Lemma II. 1[ Lemma 12.31 anci Propositions 12.41 and 12.5^ we can now prove Theorem 11.21 

Theorem II. 21 For any fixed positive integer d and fixed (r+s) xt integer matrix A there is a polynomial 
oracle-time algorithm that, given n, vectors wi, . . . ,Wd G Z, nt and b G r L r+ns , and convex function 
c : M. d — > M. presented by a comparison oracle, solves the convex n-fold integer maximization problem 

max{c(wix, . . . ,w d x) : A^x = b, x G N n *} . 
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Proof. The algorithm underlying Proposition 12.51 provides a polynomial time realization of a linear 
integer programming oracle for and b. The algorithm underlying Prop osition 12 . 4 1 allows to compute 
the Graver basis Q(A^) in time which is polynomial in the input. By Lemma [2.3l this set E := Q(A^) 
covers all edge-directions of the polyhedron conv{x G N n * : A^x = b} underlying the convex integer 
program. Thus, the hypothesis of Lemma ll.ll is satisfied and hence the algorithm underlying Lemma 
11.11 can be used to solve the convex integer maximization problem in polynomial time. □ 

3 Applications 

We now discuss various applications of our results to multiway transportation problems, packing 
problems, vector partitioning and clustering, extending and unifying applications from [T2" l fl"9 [ [23 ], [24] . 

3.1 Multiway transportation problems 

A A:- way transportation polytope is the set of all mi x • • • x nik nonnegative arrays x = (x^ ... i h ) such 
that the sums of the entries over some of their lower dimensional sub-arrays (margins) are specified. 
More precisely, for any tuple . . . , if.) with ij G {1, . . . , mj}\J {+}, the corresponding margin a^,...,^ 
is the sum of entries of x over all coordinates j with ij = +. The support of . . . , ij-) and of i k is 
the set supp(?i, . . . ,1^) := {j : ij ^ +} of non-summed coordinates. For instance, ifxisa4x5x3x2 
array then it has 12 margins with support F = {1, 3} such as X3 i+j 2,+ = Sf 2 =i Si 4 =i x 3,i2^M- Given 
a family T of subsets of {1, . . . ,k} and margin values u^. j fc for all tuples with support in the 
corresponding /c-way transportation polytope is the set of nonnegative arrays with these margins, 

7> = { x G M™ lX '" xmfc : x ilr .. )ik = u ilr .. t i k , supp(*i, . . . , i k ) G T } . 

Transportation polytopes and their integer points (called contingency tables by statisticians), have 
been studied and used extensively in the operations research literature and in the context of secure 
statistical data disclosure by public agencies, see [U EJ [TJ EJ [HI [26l EH [32] and references therein. 

We now show that when two sides p,q of a 3- way transportation problem are fixed and one side n is 
variable, the problem is an n-fold integer programming problem, and we could therefore conclude that 
the convex line-sum 3-way integer transportation problem is solvable in polynomial time. Consider 
the n-fold programming equations as described after Theorem 11.21 in the introduction. Re-index the 
arrays as x = (x 1 , . . . , x n ) with each x k := (s*,-) := (^i,i,fe, • • • , x p,q,k) suitably indexed as a pq vector 
representing the k-th layer of x. Let r := t := pq and s := p + q, and let A be the (r + s) x t 
matrix with A\ := I pq the pq x pq identity and with A^ the (p + q) x pq matrix of equations of 
the usual 2-way transportation problem for p x q arrays. Finally, define the right-hand side b = 
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(b°, b 1 , . . . , b n ) from the given line-sums by b° := (uij) and b k := ((^jfc), (zj,k)) f° r k = l,...,n. 
Then the equations Ai(Y^ k= iX k ) = ^° represent the constraints a?ti,+ = of an margins with 
support {1, 2}, where summation over layers occurs, whereas the equations A2X k = b k for k = 1, . . . , n 
represent the constraints = and x+,j,k = %',fc of an margins with support {1,3} or {2,3}, 

where summations are within a single layer at a time. Thus, generalizing the recent results of |12j for 
linear objective functions, we obtain the following remarkable corollary of Theorem 11.21 

Corollary 11.31 For any fixed d,p,q there is a polynomial oracle-time algorithm that, given n, arrays 
W\, . . . , Wd G Z pxqxn , u E 7j pxq , v € V xn , z G Z qxn , and convex c : M. d — ► R presented by comparison 
oracle, solves the convex integer 3-way transportation problem 

max{c(wis,...,w d x) : x G N px<?xn , ^ x iJik = z jtk , ^ x { = v i>k , a;» = w» j } • 

As mentioned before, this is in contrast with the case when the dimensions of two sides of the tables 
are variable, in which even the linear integer 3-way transportation problem is NP-hard, see [9| ll01fTT] . 

The following very general extension of Corollary 11.31 holds as well. Consider transportation prob- 
lems of any fixed dimension k for long arrays, namely mi x • • • x m^-i x n arrays where mi, . . . , m^-i 
are fixed and only the length (number of layers) n is variable. Further, let T be any family of subsets 
of {1, . . . , k} (the family of supports of fixed margins). Now re-index the arrays as x = (x , . . . , x n ) 
with each x 3 = {x^ ... j) a suitably indexed vector representing the j-th layer of x. Then this again 
is a convex n-fold integer programming problem with an (r + s) x t defining matrix A, with t := J^m,, 
with r,s, A\ and A2 suitably determined from J 7 , and with the right-hand side determined from the 
given margins, in such a way that the equations -Ai(X^j=i = ^° represent the constraints of all 
margins i k with i k = + (where summation over layers occurs), whereas the equations A2X 1 = \P 
for j = l,...,n represent the constraints of all margins Xi t i k with i k ^ + (where summations 
are within a single layer at a time) . We obtain the following corollary of Theorem 11.21 providing the 
polynomial time solvability of a very broad class of convex integer multiway transportation problems. 

Corollary 3.1 For any fixed d, k, mi, . . . , mt-i, and family T of subsets of {1, . . . , k}, there is a 
polynomial oracle-time algorithm that, given n, arrays wi,...,Wd G Z miX '" xmk ~ lXn , margin values 
u ii ... i k f or all tuples . . . ,i k ) with support in T , and convex c : M. d — > K presented by comparison 
oracle, solves the corresponding convex integer multiway transportation problem 

max{c(u;ix,...,ii; d x) : x G pf^ix— xm fc _ixn ^ x ily . 4k = u ilr „ >ik , supp(ii, . . . , i k ) G J 7 } . 
3.2 Packing problems 

We consider the following rather general packing problem, which concerns maximum utility packing 
of many items of several types in various bins subject to weight constraints. More precisely, the data 
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is as follows. There are t types of items. The weight of each item of type j is Vj and there are rij 
items of type j to be packed. There are n bins, where bin k has maximum weight capacity life. In the 
linear version of the problem, there is one utility matrix w G Z* xn where Wj & is the utility of packing 
one item of type j in bin k, and the objective is to find a feasible packing of maximum total utility. 
In the more general convex version, there are d utility matrices wi, . . . ,Wd G Z* xn , representing the 
packing utilities under d different criteria. The total utility is the "balancing" of these linear utilities 
under a given convex functional c on M. d . By incrementing the number t of types by 1 and suitably 
augmenting the data, we may assume that the last type t represents "slack items" which occupy the 
unused capacity in each bin, where the weight of each slack item is 1, the utility under each of the d 
criteria of packing any slack item in any bin is 0, and the number of slack bins is the total residual 
weight capacity n t := Y^l=i u k ~ X^=i n j v j- x e N* xn be a variable matrix where Xj^ represents 
the number of items of type j to be packed in bin k. Then the convex packing problem is: 

max{ c(w\X, . . . , Wdx) : x G N txn , v j x j,k = Uk , Xj^ = nj } . 

j k 

By suitably arranging the variables in a vector, it is not hard to see that this is a convex n-fold integer 
programming problem with a (t + 1) X t defining matrix A, where A\ := It is the t X t identity matrix 
and .A 2 := (v\, . . . , vt) is a 1 x t matrix. Thus, we obtain the following corollary to Theorem II. 2i 

Corollary 3.2 For any fixed number t of types and type weights v\,...,vt, there is a polynomial 
oracle-time algorithm that, given n, item numbers rij, bin capacities u/., utilities wi, . . . ,Wd G Z ixn , 
and convex c : M. d — > R presented by comparison oracle, solves the convex integer bin packing problem. 

Note that an interesting special case of bin packing is the classical cutting stock problem, and a similar 
corollary regarding the solvability of a suitable convex cutting stock problem can be obtained as well. 

3.3 Vector partitioning and clustering 

The vector partition problem concerns the partitioning of n items among p players to maximize social 
value subject to constraints on the number of items each player can receive. More precisely, the data 
is as follows. With each item i is associated a vector Vi G Z fc representing its utility under k criteria. 
The utility of player h under partition ir = (tt\, . . . ,ir p ) of the set of items {1, ... ,n} is the sum 
:= Y2i£w h v i °f utility vectors of items assigned to h under tt. The social value of it is the balancing 
c(vi^, . . . , . . . , Vp X , ■ ■ ■ ,Vp k ) of the player utilities, where c is a convex functional on R pfc . In the 
constrained version, the number | vr^ | of items that player h gets is required to be a given number 
(so ^ Aft = n). In the unconstrained version, there is no restriction on the number of items per player. 

Vector partition problems have applications in diverse fields such as clustering, inventory, reliability, 
and more - see O El HH [191 1201 [Ml [25] and references therein. Here is a typical example. 
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Example 3.3 Minimal variance clustering. This is the following problem, which has numerous 
applications in the analysis of statistical data: given n observed points vi, . . . ,v n in /c-space, group the 
points into p clusters tti, . . . , tt p so as to minimize the sum of cluster variances given by 

Eu^Eii^-(^i2>)ii 2 . 

t - ^ ^ \n h \ ^ 

h=l *S7Th tGTTj, 

Consider the instance where there are n = pm points and the desired clustering is balanced, that 
is, the clusters should have equal size m. Suitable manipulation of the sum of variances shows that 
the problem is equivalent to a constrained partition problem, where = m for all h, and where the 
convex functional c : R pfc — ► R (to be maximized) is the Euclidean norm squared, given by 

p k 

c(z) = \\z\\ 2 = ^2^2\zh,i\ 2 ■ 

h=l 1=1 

If either the number of criteria k or the number of players p is variable, the partition problem 
is intractable since it instantly captures NP-hard problems [19J. When both k,p are fixed, both the 
constrained and unconstrained versions of the vector partition problem are polynomial time solvable 
[19\ [23] . We now demonstrate how to get this result as a corollary of Theorem 11.21 by showing that 
both versions are special convex n-fold integer programming problems. There is an obvious one-to-one 
correspondence between partitions and matrices x G {0, l}P xn with all column-sums equal to one, 
where partition it corresponds to the matrix x with Xh,% = 1 if i € vr^ and Xh,i = otherwise. Let 
d := pk and define d matrices Whj G Z pxn by setting (whj)h,i '■= Vij for all h = 1, . . . ,p, i = 1, . . . , n 
and j = 1, . . . , k, and setting all other entries to zero. Then for any partition ir and its corresponding 
matrix x we have ■ = Whjx for all h = 1, . . . ,p and j = 1, . . . , k. Therefore, we obtain that the 
unconstrained vector partition problem is the convex integer programming problem 

max{ c(wi t ix, . . . , w p ^x) : x£f x ", } j Xh,i = 1 } ■ 

h 

Suitably arranging the variables in a vector, it is not hard to see that this is a convex n-fold integer 
programming problem with a (0 + 1) x p defining matrix A, where A± is empty and A<± := (1, . . . , 1). 
Similarly, the constrained vector partition problem is the convex integer programming problem 

max{ c{w\ t ix, . . . , w Pik x) : x G N pxn , ^ x h)i = 1, ^ x h)i = \ h } . 

h i 

Again, it can be seen that this is a convex n-fold integer programming problem, now with a (p+ 1) x p 
defining matrix A, where now A\ := I p is the p x p identity matrix, and A2 '■= (1, . . . , 1) as before. 

Thus, we obtain the following corollary to Theorem 11.21 

Corollary 3.4 For any fixed number p of players and number k of criteria, there is a polynomial 
oracle-time algorithm that, givenn, item vectors V{ G Z fc , positive integers Xh, and convex c : MP k — ► R 
presented by comparison oracle, solves the constrained and the unconstrained vector partition problems. 
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